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I.  Problem  Statement 

As  part  of  the  Management  and  Leadership  Workshop  held  in  Phoenix  in 
November  1985,  each  participant  was  required  to  undertake  and  complete  a 
"management  project."  The  workshop  material  defined  a  management 
project  to  be: 

A  long-term  effort  that  has  been  jointly  identified  by 
the  participant  and  his/her  supervisor  or  manager  as 
something  which  will  benefit  the  Bureau,  interest  the 
participant  and  add  to  their  competency  as  a  manager.  It 
could  be  a  demonstration  project,  a  feasibility  study  or 
the  solution  of  a  problem.  Ideal  management  projects 
involve  innovation,  creativity  and  problem-solving. 

During  my  career  with  the  Bureau,  I  have  observed  inconsistencies  in  how 
Performance  Improvement  and  Position  Reviews  (PIPRs)  are  prepared  and 
how  employees  are  rated.  I  have  also  noted  there  is  usually  a  downturn 
in  morale  when  PIPRs  are  prepared  and  evaluations  made.  I  have 
attributed  these  problems  to  inconsistencies  in  the  application  and  use 
of  the  Bureau's  PIPR  system.  After  discussions  with  the  district  and 
area  managers  in  Grand  Junction,  we  decided  that  a  survey  of  BLM 
managers  to  determine  what  factors  affected  the  summary  PIPR  rating 
would  be  an  appropriate  "management  project"  for  the  Management  and 
Leadership  Workshop. 

The  concept  of  conducting  this  survey  was  presented  to  and  approved  at 
the  workshop.  Based  upon  conversation  at  the  workshop  and  within  the 
Grand  Junction  District  office,  it  was  decided  to  expand  the  survey  to 
develop  an  understanding  of  how  PIPRs  are  prepared  througnout  the  Bureau 
and  to  offer  the  participants  an  opportunity  to  evaluate  the  PIPR 
system. 

II.  Methodology 

After  determining  that  the  survey  would  constitute  a  project  consistent 
with  the  goals  of  the  Management  and  Leadership  Course,  the  next  steps 
were  to  determine  the  sample  size,  decide  who  should  be  sampled,  and 
develop  the  questionnaire. 

The  supervisory  group  to  be  targeted  by  the  survey  was  determined  by 
using  the  1985  Colorado  BLM  directory  and  the  Bureau  directory  as 
guides.  Comparing  the  Colorado  BLM  directory  with  the  Bureau  directory, 
it  was  evident  that  you  could  not  locate  supervisors  below  the  branch 
chief  level  in  state  offices  nor  supervisors  below  the  area  manager  in 
resource  area  offices   Therefore,  supervisors  below  these  levels  were 
omitted  from  this  sur^v.  Using  the  Bureau  directory,  it  was  determined 
that  one  could,  for  e.;  :h  state,  consistently  find  state  directors, 
associate  state  directors,  deputy  state  directors,  brancn  chiefs, 
district  managers,  and  area  managers.  Given  the  Bureau's  organizational 
structure,  it  was  assumed  that  each  district  would  have  assistant 
district  managers  for  administration,  lands  and  renewable  resources,  and 
operations  and  some  districts  would  also  have  assistant  district 
managers  for  minerals.  Given  the  wide  distribution  of  these  groups,  the 
likelihood  of  involvement  with  PIPRs,  and  the  ability  to  find 


appropriate  personnel  in  the  Bureau  directory,  it  was  decided  that  the 
sample  group  would  consist  of  state  office  branch  chiefs,  district 
managers,  associate  district  managers,  and  area  managers.  Personnel  in 
the  Washington  Office  and  Denver  Service  Center  were  omitted  from  the 
survey  as  the  survey  was  primarily  directed  toward  the  field  supervisors. 

Given  the  above,  it  was  somewhat  arbitrarily  decided  to  survey  four 
state  office  branch  chiefs,  two  district  managers,  three  or  four 
assistant  district  managers  (the  fourth  assistant  district  manager  would 
be  the  assistant  district  manager  for  minerals  if  present  in  that 
state),  and  four  area  managers  per  state.  Also,  based  upon  the  Bureau's 
organization,  allowances  were  made  for  the  Eastern  States  and  Oregon. 
Overall,  this  resulted  in  a  sample  of  160  supervisors  scattered 
throughout  the  Bureau's  11  western  states  and  the  Eastern  States  office. 

Table  1  shows  the  number  of  surveys  sent  to  supervisors  in  each  category 
by  state  along  with  total  return  rates.  As  can  be  seen,  there  was  an 
overall  return  rate  of  88  percent.  However,  no  statistical  measures 
were  employed  to  ensure  the  sample  design  and  return  rate  constituted  a 
valid  survey.  It  is  felt  that  each  category  had  a  sufficiently  high 
return  rate  to  make  this  a  valid  survey  of  the  supervisor  categories 
surveyed  throughout  the  Bureau.  Generally  speaking,  this  is  a  very  high 
return  rate  for  all  supervisory  categories  and  all  states  except  Eastern 
States. 


Table  1 

Distribution  and  Return  of  Questionnaires 

by  State  and  Supervisory  Category 


1      Total      1    SOl/          1    DMi/             ADM?/        1     AMi/ 

State                              ISentlRet. |Sent|Ret. ISentlRet. ISentlRet. ISentlRet. 

Alaska                                        1141121     31     21     3   I     3    I     4|     4|     4   I     3 
Arizona                                      |   13   I   12   I     4   I     4|     2   I     1    I     3   I     31     4   I     4 
California                                  |   13   I    10   |     41      1    |     21      2   I      3   I      31     4]      4 
Colorado                                     |    14   |   12    |     4   |     4    |      21      2    I     4   |      31     4   |      3 
Eastern  States                         |6|2|4|1|2|1|-|-|-|- 
Idaho                                           1131121     4   I      3    I      2    I      21      3   |      3    I      4   |      4 
Montana                                       |   14   |    13   I     4   |      4]      2   |      11     4|     4   |     41      4 
Nevada                                         |   13   I   11    1      41     4   |      2   |      1    |      3   |      2    I      4   I     4 
New  Mexico                                 |   14   I    13   I     4   |     4   |      21      21     41     4   |      4    |      3 
Oregon                                        |   19   I   19   I     4   I     4   I     4   I     4   I     3   I     31     8   I     8 
Utah                                             1131121     4|     4   |      2    |      21      31      21     4)      4 
Wyoming                                           14   1    13    I     4   I     4    I      2    1      21     4   |      3   |     4   I     4 

Totals                             '160  1141    I   47   I   35   I   27   I   23   |   38   I   34  I   48   I   45 

%  Return                                   I   88   I         |  74   |          I   85   |         j  89   I          I   94 

-  State  Office  Branch  Chief 

2/ 

-  District  Manager 

3/  .  . 

—  Assistant  District  Manager 

4/  A 

—  Area  Manager 


After  determining  the  sample  size  and  sample  distribution,  it  was 
necessary  to  develop  the  questionnaire.  The  overall  purpose  of  the 
survey  was:  (1)  to  determine  if  factors  other  than  actual  work 
performance  affected  a  summary  rating;  (2)  to  determine  how  PIPRs  were 
prepared;  (3)  to  determine  how  supervisors  tnink  the  PIPR  system  is 
working;  and  (4)  to  determine  if  different  states  and/or  supervisory 
categories  varied  in  their  responses  to  the  above. 

Three  sets  of  questions  corresponding  to  the  first  tnree  categories 
above  were  prepared.  These  draft  questions  were  then  reviewed  by  staff 
and  supervisors  in  the  Grand  Junction  District,  and  the  questionnaire 
was  then  revised  based  upon  the  comments.  The  questionnaire  was  then 
tested  on  a  few  managers  in  tne  Grand  Junction  District  and  reviewed  by 
Gordon  Jennings,  DSC,  and  again  revised.  A  copy  of  the  survey  is  found 
in  Appendix  A. 

The  survey  was  then  sent  to  160  BLM  supervisors  on  April  14,  1986. 
After  five  weeks,  88  percent  of  the  questionnaires  had  been  returned. 
Upon  receipt,  each  returned  survey  was  recorded  to  show  only  the  state 
and  supervisory  category,  tne  envelope  showing  the  individual  responding 
was  destroyed,  and  tne  data  were  compiled  on  response  sheets.  The  data 
were  then  transferred  to  tables  to  record  responses  by  supervisory 
category  Dy  state.  Finally,  they  were  then  consolidated  into  the  tables 
shown  in  the  next  chapter  and  Appendix  B.  Because  of  the  nature  of  the 
data,  the  questions  asked,  and  tne  audience,  data  analysis  using  chi 
square,  t  test,  variance,  etc.,  was  thougnt  not  to  be  appropriate. 
Simple  percentages  are  primarily  used  to  illustrate  differences  between 
states  and  supervisory  category. 

It  should  be  noted  that  not  all  respondents  completed  the  entire 
questionnaire.  It  should  also  be  noted  that  some  respondents  provided 
more  than  one  answer  to  a  question.  Therefore,  most  questions  do  not 
have  exactly  141  responses. 

III.  Findings 

A.  Introduction 

Questionnaire  data  nave  been  compiled  and  summarized  by  state  and 
supervisory  category.  The  data  presented  in  tnis  chapter  and  used 
as  the  primary  points  of  discussion  are  simple  percentage 
relationships.  Appendix  B  contains  a  numerical  tabulation  of  the 
data.  For  all  questions,  it  is  important  to  note  that  while  the 
sample  size  for  any  particular  state  or  supervisory  category  is 
considered  a  representative  sample,  when  disaggregated  tne  sample 
size  is  fairly  s   1  and  slight  changes  in  responses  significantly 
affect  the  perce~~iges  discussed. 

B.  Factors  Affecting  PIPR  Ratings 

This  portion  of  the  survey  was  designed  to  determine  if  factors 
other  than  observed  performance  affect  PIPR  summary  ratings. 


Table  2  snows  the  distribution  of  responses  by  state  and  Table  3 
the  distribution  of  responses  by  supervisory  category  for  questions 
A-l  through  A-5. 


Table  2 
Responses  to  Questions  A-l  through  A-5 

(Percent) 


by  State 


A-l 

A-2 

A- 

•3 

A-4                      | 

a 

b 

c 

A-5 

State 

Yes  1  No 

Yes  I  No 

Yes 

No 

Yes  1  No 

Yes  I  No 

Yes  I  No 

Alaska 

81   92 

0|  100 

8 

92 

81   92 

81   92 

0| 1001 

25 

Arizona 

01 100 

onoo 

33 

67 

81   92 

onoo 

01 1 00| 

1     o 

California 

501   50 

0|  100 

40 

1   60 

201   80 

01100 

01 100| 

1     o 

Colorado 

01100 

171   73 

25 

75 

onoo 

01100 

0 1 1001 

1    o 

Eastern  States 

01 100 

onoo 

50 

1   50 

01100 

I     01100 

1     01 1001 

1    o 

Idaho 

42|    58 

01 100 

18 

82 

33|   67 

onoo 

171   831 

1    o 

Montana 

46|   54 

8|   92 

31 

69 

46|   54 

151   85 

15|   851 

1     8 

Nevada 

36|   64 

01100 

9 

91 

0|  100 

01100 

011001 

1     9 

New  Mexico 

231   77 

01100 

38 

62 

151   85 

01100 

011001 

I   23 

Oregon 

111   89 

01100 

21 

79 

161   84 

0)100 

16|   84| 

1     o 

Utah 

171   83 

81   92 

25 

75 

171   83 

01100 

81   921 

1   17 

Wyoming 

38|   62 

81   92 

38 

62 

461    54 

38|   62 

231   77| 

15 

Totals 

231   77 

41    96 

26 

74 

191    81 

61    94 

81    921 

9 

Table  3 
Responses  to  Questions  A-l  through  A-5  by  Supervisory  Category 

(Percent) 


1                1 
A-l      |     A-2     | 

1 

A-4 

A-3      I         a      I 

b        1 

c               A-5 

Yes  I  No   lYesINo   I 

Yes  1  No    I  Yes  1  No   1 

Yes  1  No   1 

Yes  1  No   1   # 

1    NR 

State  Office 
District  Manager 
Assistant  District  Manager 
Area  Manager 

Totals 

1        1        1        1 

311   691     011001 

81    921     011001 

21  I   791     91   91  I 

271   731     41    961 

1        1        1        1 

231    771     41    96| 

1  1  1  1 
261  74|  15|  851 
331  67|  131  871 
271  73|  27|  731 
23]    771   20|   80| 

III! 
261   741    191   81  I 

1  1 
5|  951 
81  92| 
91  911 
21    981 

1  1 
6|    941 

~~r~ri 

31   971 
4|    96| 
91    91  I 
13|   871 
1        1 
81    92| 

13 
8 
6 

7 

1      9 

A-l.     Has  a  summary  rating  been  affected  by  a  quota  established  by  a 
higher  office?        Yes  No 

Almost  one-    iurtfi   (23%)  of  the  respondents  answered  yes  to 
this  questi      .     One-third  to  one-half  of  the  respondents  from 
California,  Montana,   Idaho,  Wyoming,  and  Nevada  all    reported 
that  a  quota  affected  a  summary  PIPR  rating.     District 
managers  were  the  only  supervisory  category  that  reported  that 
quotas  did  not  significantly  affect  summary  ratings.     As  an 
observation,   it  should  be  noted  where  almost  one-fourth  of  the 
respondents  stated  that  quotas  affected  PIPR  summary  ratings, 
then  the  summary  rating  should  not  be  viewed  as  an  accurate 
reflection  of  performance. 


Yes 

No 

"  Yes 
Yes 

No 
No 

A-2.     Has  a  summary  rating  been  affected  by  an  employee's  desire  to 
be  promoted/transferred  where  a  high  PIPR  rating  would  be 
required  to  be  considered  for  a  promotion/transfer?  Yes 
No                                                                                      

Only  4  percent  of  the  total    respondents  answered  yes  to  this 
question.     Responses  to  this  question  did  not  vary  much  from 
one  state  to  another.     Assistant  district  managers  were  the 
group  most  likely  to  respond  yes  to  this  question,  but  only  to 
a  very  slight  degree. 

A-3.     Has  a  summary  rating  been  affected  by  your  desire  to  get 

better  work  out  of  an  employee  in  the  future  rather  than  on 
past  performance?    Yes  No 

About  one-fourth  of  the  total    respondents  answered  yes  to  this 
questions.     This  consideration  was  least  important  in  Alaska 
and  Nevada  and  was  more  widely  used  in  Eastern  States, 
California,  New  Mexico,  and  Wyoming.     The  variation  between 
supervisory  categories  is  not  that  great,  but  district 
managers  were  the  most  likely  group  to  use  tnis  technique. 

A-4.     Has  a  summary  rating  been  affected  by  any  of  the  following: 

a.  potential   for  an  award? 

b.  merit  promotion  plan? 

c.  possible  reduction  in  force? 

Summary  ratings  were  more  than  twice  as  likely  to  be  affected 
by  the  potential    for  an  award   (19%)  as  opposed  to  the  merit 
promotion  plan  (6%)  or  a  possible  reduction  in  force  (8%). 
Colorado,   Eastern  States,  and  Nevada  reported  that  the 
potential    for  an  award  has  no  effect  on  the  summary  rating 
while  California,  Montana,  New  Mexico,  Oregon,   Utah,   and 
particularly  Wyoming  all    said  it  is  an  important 
consideration.     All    supervisory  categories  said  that  the 
potential    for  an  award  affected  PIPR  summary  ratings,  but 
assistant  district  managers  were  most  likely  to  do  this. 

Only  Alaska,  Montana,  and  Wyoming,  and  then  only  sligntly, 
reported  that  the  merit  promotion  plan  affects  summary 
ratings.     Tnis  was  less  important  to  area  managers  as  opposed 
to  otner  supervisory  categories. 

A  possiole  reduction  in  force  affected  summary  ratings  in 
Idano,  Montana,  Oregon,  and  Wyoming.     Area  managers  were  most 
likely  to  r      -nfluenced  by  tnis,  and  state  office  branch 
chiefs  were  "ne  least  likely  to  use  this  as  a  consideration  in 
the  PIPR  sij     iry  rating. 

A-5.     If  you  answered  yes  to  any  of  the  above  questions,  to  what 

extent  do  factors  other  than  observed  work  performance  affect 
the  summary  ratings? 

01  23456789  10 


These  responses  were  not  compiled  by  state  or  supervisory 
category.  Almost  one-half  (49%)  of  all  respondents  indicated 
that  none  of  the  factors  discussed  above  had  any  effect  on  the 
summary  PIPR  rating.  Nine  percent  of  the  respondents  answered 
yes  to  one  of  tne  previous  questions  but  did  not  indicate  any 
degree  of  influence.  For  those  remaining,  21  percent 
indicated  tnere  was  a  low  influence  (1-3),  14  percent  said 
there  was  a  moderate  influence  (4-6),  and  8  percent  said  there 
was  a  strong  influence  (7-10). 

In  summary,  the  purpose  of  this  portion  of  the  survey  was  to  develop 
and  understanding  of  what  really  affects  the  overall  summary  PIPR 
rating.  Astonishingly,  51  percent  indicated  that  the  summary  rating 
was  affected  by  things  other  than  observed  performance.  Generally, 
this  influence  was  low  to  moderate,  but  it  is  present.  Factors  most 
likely  to  affect  the  summary  rating  were  a  quota  established  by  a 
higher  office,  the  desire  to  get  better  work  out  of  an  employee  in 
the  future,  and  the  potential  for  an  award.  All  states  and  all 
supervisory  categories  were  influenced  by  things  other  than  observed 
performance  to  an  important  degree  when  establishing  summary  PIPR 
ratings. 

C.  How  PIPRs  Are  Developed 

The  second  part  of  the  survey  was  designed  to  develop  and 
understanding  of  how  PIPRs  are  prepared.  Table  4  shows  tne 
distribution  of  responses  by  state  and  Table  5  shows  the 
distribution  of  responses  by  supervisory  category  for  questions  8-1 
through  B-8,  except  for  question  B-7c  which  is  shown  in  Table  6. 

B-l .  Do  your  employees  solely  prepare  their  own  PIPRs?   Yes 

No 

B-2.  Do  you  solely  prepare  PIPRs  for  your  employees?   Yes 

No. 

B-3.  Do  you  and  your  employees  prepare  their  PIPRs  jointly? 
Yes    No 

The  responses  to  questions  Bl ,  B2,  and  B3  were  almost  always 
no,  no,  and  yes,  respectively.  There  was  little  variance 
between  states  (Nevada  was  most  likely  to  respond  yes  to  Bl 
and  Colorado  yes  to  B2)  or  supervisory  category  (state  office 
branch  chiefs  were  most  likely  to  answer  yes  to  B2). 

B-4.  Are  PIPRs  developed  each  year  based  upon  the  following: 


a. 

positi   description? 

Yes 

No 

b. 

AWP  con;  itments? 

Yes 

"  No 

c. 

previous  year's  PIPR? 

Yes 

No 
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Annual  work  plan  commitments,  position  descriptions,  and  the 
previous  year's  PIPR  were,  in  that  order,  the  most  important 
things  used  in  preparing  a  PIPR.  Generally,  there  was  little 
variance  from  one  state  to  the  next  in  the  importance  of  the 
position  description  or  the  AWP  commitments.  Some  variance 
was  shown  in  the  use  of  the  previous  year's  PIPR  with  Alaska, 
Eastern  States,  and  Colorado  placing  more  emphasis  on  this 
while  Montana  and  New  Mexico  placed  less.  Supervisory 
categories  varied  somewhat  in  their  responses  to  these 
questions.  Assistant  district  managers  were  the  group  who 
most  heavily  relied  on  the  position  description.  District 
managers  were  most  likely  to  rely  on  the  previous  year's  PIPR 
while  state  office  branch  chiefs  were  least  likely  to  use  the 
previous  year's  PIPR. 

B-5.  When  do  you  prepare  PIPRs? 

a.  start  of  fiscal  year        

b.  mid-year  

c.  end  of  fiscal  year         


Overall,  the  variations  in  response  to  this  question  were  not 
that  great.  Ninety  percent  said  that  PIPRs  were  prepared  at 
the  start  of  a  fiscal  year,  6  percent  at  mid-year,  and  4 
percent  at  the  end  of  the  fiscal  year.  Witnin  states,  the 
greatest  variance  was  shown  in  Colorado,  Eastern  States,  and 
Utah.  Arizona,  California,  Nevada,  and  New  Mexico  all 
reported  that  PIPRs  were  solely  prepared  at  the  start  of  the 
fiscal  year.  Greater  variance  was  shown  on  this  question 
between  supervisory  categories.  District  managers  were  most 
likely  to  prepare  PIPRs  at  mid-year  (15%),  and  area  managers 
overwnelmingly  prepared  PIPRs  at  the  start  of  the  fiscal  year 
(98%). 

B-6.  Are  standardized  job  elements  and  objectives  used  for  some 
tasks  (safety,  EEO,  etc.)? 

Yes  No 


A  very  large  majority  (92%)  of  the  respondents  use  some 
standardized  elements  and  objectives  when  preparing  PIPRs. 
One  hundred  percent  of  the  respondents  from  seven  states  said 
they  used  standardized  language,  while  California,  Colorado, 
and  Montana  were  the  least  likely  states  to  use  standardized 
language.  Tnere  is  very  little  variance  between  the 
supervisory  categories. 

B-7.  In  rating  performance,  do  you  solely  use: 

a.  qualitative  standards?  

b.  quantitative  standards?  

c.  or  a  combination? 
if  yes,  %   qualitative  ,  %   quantitative 


Yes 

No 

Yes 

No 

Yes 

"  No 

The  answers  to  these  questions  were  almost  always  no  (99%),  no 
(99%),  and  yes  (94%),  respectively.  The  greatest  variance 
noted  was  that  10  percent  of  the  area  managers  stated  that  a 
combination  of  qualitative  and  quantitative  standards  were  not 
used. 

Concerning  the  relative  importance  of  qualitative  versus 
quantitative  standards,  only  4  percent  of  the  respondents  said 
that  a  combination  of  qualitative  and  quantitative  standards 
were  not  used  to  prepare  PIPRs;  12  percent  of  the  respondents 
did  not  indicate  the  relative  proportion  of  qualitative  or 
quantitative  standards  used;  23  percent  said  that  there  was  a 
50-50  breakdown;  30  percent  indicated  qualitative  standards 
were  more  important;  and  32  percent  indicated  that 
quantitative  standards  were  more  important.  No  analysis  was 
made  to  identify  differences  between  states  or  between  states 
or  between  supervisory  categories.  Table  6  shows  the  relative 
distributions  as  to  the  importance  of  qualitative  or 
quantitative  standards. 


TABLE  6 
RESPONSES  TO  QUESTION  B-7c 
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B-8.  Are  PIPRs  reviewed  with  employees? 

a.  quarterly  _ 

b.  semi-annually 

c.  annually 


Responses  to  this  question  varied  significantly.  Twenty  percent  of 
the  respondents  stated  that  PIPRs  were  reviewed  quarterly  with 
employees;  74  percent  stated  semi-annually;  and  6  percent  stated 
annually.  Tne  most  consistent  states  were  Alaska,  California,  and 
Oregon  while  the  lease  consistent  states  are  Arizona,  Nevada,  and 
Utah.  Responses  between  supervisory  categories  were  also  markedly 
different,  with  state  office  branch  chiefs  and  district  managers  in 
one  group  and  assistant  district  managers  and  area  managers  in 
another  group. 

In  summary,  the  responses  to  this  section  were  very  consistent. 
Approximately  98  percent  of  the  respondents  said  PIPRs  are  jointly 
prepared  witn  employees.  Position  descriptions,  AWP  commitments,  and  the 
previous  year's  PIPR  all  have  a  strong  influence  on  the  preparation  of 
PIPRs.  Over  90  percent  of  the  PIPRs  are  prepared  at  the  start  of  the 
fiscal  year,  with  94  percent  of  the  PIPRs  containing  some  type  of 
standardized  elements.  About  94  percent  of  the  PIPRs  contain  both 
qualitative  and  quantitative  elements,  and  most  PIPRs  (74%)  are  reviewed 
semi-annually  with  the  employees.  Variations  in  responses  between  states 
can  be  considered  minor  wnile  there  are  some  important  variations  between 
supervisory  categories,  particularly  to  questions  B-4  and  B-8.  Overall, 
there  appears  to  be  a  great  deal  of  consistency  in  how  PIPRs  are 
prepared. 

D.  Supervisor's  Evaluation  of  the  PIPR  System 

The  third  part  of  the  survey  was  designed  to  solicit  an  evaluation  of  the 
PIPR  system  and  to  allow  individuals  to  suggest  methods  of  improvement 
for  the  PIPR  system.  Tables  7  and  8  show  the  distribution  of  responses 
to  questions  C-l  through  C-7  for  each  state  and  supervisory  category, 
respectively.  Written  responses  were  not  tabulated  by  state  or 
supervisory  category.  The  written  responses  were  analyzed  by  type  of 
answer  (yes  or  no)  to  give  some  indication  of  the  attitudes  of  the 
respondents.  It  is  interesting  to  compare  answers  in  this  section.  For 
example,  C-l  vs.  C-7  or  C-6  vs.  C-7,  C-l  vs.  C-4. 

C-l.  Do  you  think  the  PIPR  system  is  functioning  as  it  was  designed? 
Yes     No 

Why? 


Surprisingly,  only  about  one-fourtn  (28%)  of  the  total  respondents 
thought  the  PIPR  system  was  functioning  as  it  was  designed.  The 
only  state  to  agree  with  this  statement  was  California  (67%),  three 
states  were  neutral,  while  Alaska,  Colorado,  Idaho,  and  Montana 
very  strongly  disagreed.  The  only  supervisory  category  to  somewhat 
agree  with  the  statement  were  assistant  district  managers  (42%), 
while  the  other  groups  strongly  disagreed. 
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C-2.  Do  you  as  a  supervisor  use  the  PIPR  system  to  identify  employee 

development  needs?  Yes    No 

How? 


Overall,  there  were  only  moderate  variations  in  responses  to 
this  question.  Approximately  four  out  of  five  (79%) 
respondents  answered  yes  to  this  question.  Respondents  in 
Alaska  and  Arizona  were  most  likely  to  answer  no,  while 
respondents  in  the  Eastern  States  and  Idaho  were  most  likely  to 
answer  yes.  Also,  assistant  district  managers  were  most  likely 
to  answer  yes  to  this  question. 

C-3.  Do  you  feel  that  the  five  level  rating  system  is  adequate  and 

fair?   Yes     No 

? 


Why? 


Only  50  percent  of  the  respondents  said  they  thought  the  five 
level  rating  system  is  adequate  and  fair,  while  46  percent  said 
it  is  not.  Nevada  and  Utah  were  most  likely  to  agree  witn  the 
above  statement,  while  Montana,  New  Mexico  and  Wyoming  were  the 
states  most  likely  to  disagree.  The  supervisory  categories 
broke  into  two  distinct  groups:  state  office  branch  chiefs  and 
area  managers  slightly  agreeing  that  a  five  level  rating  system 
is  adequate  and  fair  and  district  managers  and  assistant 
district  managers  moderately  disagreeing. 

C-4.  Do  you  think  such  things  as  awards,  salary  increases  through 
the  merit  promotion  plan,  etc.,  should  be  tied  to  the  summary 

PIPR  rating?         Yes     No 

Why? 


Almost  two-thirds   (63%)  of  the  respondents  said  such  things  as 
awards,   salary  increases,  etc.,  should  be  tied  to  the  summary 
rating,  while  one-third  said  they  should  not.     On  a 
state-to-state  basis,  there  was  very  little  consistency  in 
response  to  this  question.     On  a  supervisory  level,   the  state 
office  branch  chiefs  were  generally  supportive  of  tying  tne 
summary  rating  to  awards  and  salary  increases,  while  district 
managers  were  somewnat  neutral . 

C-5.     Do  you  feel   performance  is  affected  by  a  PIPR  rating? 
Yes  No 


WfiyT 


Almost  four  out  of  five  (78%)  respondents  said  they  thought 
performance  was  affected  by  the  summary  rating.  Respondents 
from  Alaska  (50%)  and  Utah  (58%)  were  least  likely  to  agree 
that  performance  is  affected  by  the  summary  PIPR  rating.  About 
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three-fourths  of  the  branch  chiefs,   district  manaqers,   and 
assistant  district  managers  said  performance  was  affected  by 
the  summary  rating,  while  84  percent  of  the  area  managers 
thought  so. 

C-6.     Generally,  do  you  think  your  employees  like  the  PIPR  system? 

Yes  No 

Why?    


Less  than  one-third  (29%)  of  all  respondents  thought  that  their 
employees  liked  the  PIPR  system.  Respondents  from  9  of  the  12 
states  generally  disagreed  with  this  statement,  with  25  percent 
or  less  of  the  respondents  from  Idaho,  Montana,  New  Mexico,  and 
Wyoming  agreeing  with  the  statement.  None  of  the  supervisory 
groups  indicated  their  employees  liked  the  PIPR  system.  State 
office  branch  chiefs  were  the  group  most  likely  to  say  their 
employees  liked  the  PIPR  system  (42%);  but,  as  a  group,  they 
also  disagreed  with  the  statement. 

C-7.  Generally,  do  you  like  the  PIPR  system?   Yes   No 

Why? 


Only  one-half  (51%)  of  all  respondents  said  they  liked  the  PIPR 
system,  while  48  percent  said  they  did  not.  The  variation  in 
responses  was  not  as  great  as  with  question  C6;  and,  overall, 
respondents  from  five  states  liked  the  system  and  respondents 
from  five  other  states  did  not  like  the  system.  Variation 
between  the  supervisory  categories  was  also  not  that  great  with 
a  low  of  41  percent  saying  they  liked  the  system  (assistant 
district  managers)  to  a  high  of  62  percent  (district 
managers). 

In  summary,  the  most  striking  finding  regarding  the  supervisors' 
responses  to  this  PIPR  evaluation  is  the  overall  variation  or 
inconsistency  in  the  responses.  Moreover,  the  responses  were 
negative  when  taken  as  a  wnole.  Only  28  percent  thought  the  PIPR 
system  was  working  as  designed;  only  50  percent  thought  the  five 
level  system  was  adequate  and  fair;  63  percent  said  awards  and  salary 
increases  should  be  tied  to  the  summary  rating;  over  75  percent 
thought  performance  is  affected  by  a  summary  rating;  only  29  percent 
thought  their  employees  liked  the  PIPR  system;  and  only  51  percent 
said  they  liked  the  PIPR  system.  Overall,  I  thing  the  data  show  that 
supervisors  are  very   much  dissatisfied  with  the  way  the  PIPR  system 
is  functioning. 

IV.   Conclusions  and  Suggestions 

The  following  conclusions  and  suggestions  are   based  upon  the  findings 
reported  in  Chapter  III  or  from  my  observations  to  the  written  responses 
to  questions  C-l  through  C-7.   I  have  developed  a  suggestion  to  the 
conclusions  again  based  upon  the  findings  and  my  observations.  Also,  the 
conclusions  and  suggestions  are  somewhat  organized  according  to  the  three 

major  sections  of  the  survey. 


Appendix  D  contains  a  presentation  of  some  of  the  written  responses  to 
questions  C-l  through  C-7.  The  written  responses,  too  numerous  to  be 
included  in  this  report,  contain  some  very  relevant  information  that  should 
be  further  analyzed  and  reported.  Appendix  C  contains  two  surveys  that 
compile  PIPR  summary  ratings  for  FY  84  for  the  entire  Bureau,  for  Colorado 
from  FY  82  through  FY  84,  and  a  comparison  of  summary  rating  distribution 
for  employees  in  the  GM  series  for  the  Bureau  and  Colorado  in  FY  84. 

The  following  conclusions  and  suggestions  are  not  presented  in  any  priority 
order. 

A.  Conclusions  and  Suggestions  Associated  with  Questions  A-l  through  A-5 

Conclusions: 

°  There  is  a  great  deal  of  variation  in  factors  affecting  the  summary 
PIPR  rating. 

°  There  are  a  number  of  factors  other  than  observed  performance  that 
affect  summary  PIPR  ratings. 

°  There  is  a  perception  that  quotas  are  oecoming  more  and  more 
important  in  establishing  summary  PIPR  ratings. 

0  There  is  a  lack  of  uniformity  in  how  supervisors  apply  the  summary 
PIPR  rating. 

°  In  relation  to  the  summary  rating,  there  is  no  agreement  as  to  what 
is  normal,  above  normal,  or  below  normal  performance. 

Suggestions: 

°  Do  not  have  quotas  for  the  distribution  of  PIPR  ratings  established 
by  higher  offices. 

°  Require  annual  PIPR  training  for  all  supervisors.  This  training 
should  go  beyond  PIPR  preparation. 

°  Have  each  state  adopt  statewide  standards  for  similar  job 
elements. 

°  Reconsider  the  need  (requirement)  for  higher  level  review  of 
summary  PIPR  ratings. 

°  Managers  at  all  levels  should  be  evaluated  on  their  use  of  the  PIPR 
system. 

B.  Conclusions  and  Suggestions  Associated  with  Questions  3-1  tnrough  B-8 

Conclusions: 

°  Generally,  PIPRs  ar^   prepared  and  reviewed  throughout  the  Bureau 
under  similar  circumstances. 

°  It  appears  the  major  workload  for  PIPR  preparation  lies  with 
employees. 
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Suggestions: 

°  Require  that  supervisors  prepare  the  first  written  draft  of  a  PIPR 
rather  than  telling  their  employees  what  to  put  in  it. 

C.   Conclusions  and  Suggestions  Associated  with  Questions  C-l  through  C-7 

Conclusions: 

°  Supervisors  do  not  think  the  PIPR  system  is  functioning  as  it  was 
intended. 

°  Overwhelmingly,  supervisors  say  they  use  the  PIPR  system  to 

identify  future  training  needed  or  to  identify  special  projects  to 
enhance  employee  development. 

°  Supervisors  do  not  feel  the  PIPR  system  is  consistently  applied. 

°  Levels  IV  and  V  are   rarely  used  when  rating  employees. 

°  Many  of  the  "yes"  responses  to  question  C-5  indicate  that  the  PIPR 
system  may  have  an  adverse  impact  on  performance. 

°  The  inconsistency  in  the  application  of  the  summary  PIPR  rating  has 
a  high,  adverse  impact  on  morale. 

°  One  reason  why  supervisors  do  not  like  to  PIPR  system  is  they 
don't  like  to  grade  people  and  they  don't  like  to  be  graded 
themselves  (which  is  a  normal  human  response). 

°  Supervisors  think  that  some  type  of  employee  evaluation  system  is 
needed. 

°  There  is  a  general  dissatisfaction  with  the  five-level  rating 
system. 

Suggestions: 

°     Reevaluate  how  the  PIPR  system  is  presently  being  used  in  light  of 
its  original    (and  present)   purpose.     For  example,   is  the  PIPR 
system  being  encumbered  by  nonrelated  items? 

0     Make  the  PIPR  a  work  contract  only  between  tne  supervisor  and 
employee. 

°     Analyze  and  determine  if  a  two-level    or  three-level    PIPR  summary 
rating  system  should  be  adopted  instead  of  the  present  five-level 
system. 

°     Require  the  use  of  an   Individual   Development  Plan   (IDP)   for  all 
employees  desiring  one. 

0     Establish  better  communications  with  employees  on  the  purpose  and 
use  of  the  PIPP  system  and  its  potential   effects  upon  them  as 
employees  and/or  supervisors. 
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D.   General  Conclusions  and  Suggestions 

Conclusions: 

0  The  size  of  the  response  indicates  that  people  are  interested  in 
the  PIPR  system.  This  nay  well  mean  they  have  some  kind  of  problem 
with  its  operation. 

Almost  all  respondents  thought  it  was  important  to  respond  in 
writing  to  questions  C-l  through  C-7. 

Variations  in  responses  indicate  the  PIPR  system  is  not  standard 
from  one  state  to  another  nor  within  a  state. 

0  Based  upon  the  Bureauwide  complication  of  summary  ratings  from 
1984,  there  is  a  fairly  consistent  application  of  summary  ratings 
from  one  state  to  the  next. 

0  Based  upon  the  analysis  of  GM  summary  ratings,  there  is  a 

tremendous  discrepancy  between  the  summary  ratings  for  GS  employees 
as  opposed  to  GM  employees. 

Suggestions: 

°  Determine  how  much  variance  is  acceptable  in  a  supposedly 
standardized  system. 

°  Conduct  a  more  thorough  analysis  of  the  written  responses  to 
questions  C-l  through  C-7  in  this  survey. 

°  Conduct  a  survey  very  similar  to  this  one  for  nonsupervisory 
employees  and  compare  results. 

0  Conduct  surveys  similar  to  this  one  at  four-  to  5-year  intervals  to 
establish  trends. 

°  Conduct  a  study  comparing  the  Bureau's  PIPR  systems  to  other 
systems  used  by  natural  resource  management  agencies. 
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APPENDIX  A 
Questionnaire 


lft 


IN  REPLY  RF.FFR  TO: 


United  States  Department  of  the  Interior 

BUREAU  OF  LAND  MANAGEMENT 
GRAND  JUNCTION  RESOURCE  AREA 

764  Horizon  Drive 
Grand  Junction,  Colorado  81501 


BLM  Supervisor 

As  part  of  my  participation  in  the  Management  and  Leadership  Workshop,  I  am 
conducting  a  survey  of  a  representative  sample  of  BLM  supervisors.   The 
purpose  of  this  survey  is  to  obtain  information  about  the  use  of  the  Bureau's 
Performance  Improvement  and  Position  Review  (PIPR)  system.   The  survey  is 
designed  to  determine  if  some  factors  other  than  work  performance  affect 
summary  PIPR  ratings,  to  discover  how  PIPRs  are  prepared,  and  to  obtain  a 
general  evaluation  of  the  PIPR  system. 

The  information  gathered  through  this  survey  will  be  analyzed  to  determine  if 
there  are  any  significant  variations  in  the  total  responses,  between 
organizational  levels,  within  the  same  organizational  level,  and,  if  the  data 
so  indicates,  to  suggest  changes  be  made  to  the  PIPR  system.   The  results  of 
the  survey  will  be  presented  to  the  State  Director  in  Colorado,  the  Denver 
Service  Center  advisor  to  the  Management  and  Leadership  Workshop,  and  to 
higher  levels  in  the  organization,  if  warranted. 

The  information  you  provide  will  be  held  in  the  strictest  confidence.   I 
understand  this  is  sensitive  information,  and  you  have  my  assurance  that  the 
procedures  I  have  established  are  designed  to  maintain  anonymity.   When  the 
questionnaires  are  returned  they  will  be  recorded  to  show  only  the 
organizational  level  (i.e.,  area  office,  district  office,  or  state  office), 
not  any  particular  location.   The  envelope,  which  is  coded  to  your  location, 
will  be  destroyed  after  you  return  the  questionnaire. 


Enclosed  are  three  sets  of  questions  and  a  return  envelope.   First,  read 
through  all  the  questions  and  then  go  back  and  answer  each  question  in  turn. 
Please  return  the  completed  questionnaire  within  two  weeks  in  the  envelope 
provided. 

Your  assistance  in  completing  this  survey  is  greatly  appreciated. 


Sincerely  yours, 


'cuyyiW-  / 


w 


Vpcr 


■y 


James  M.  Keeton 

Grand  Junction  Resource  Area 

Grand  Junction,  Colorado 


Enclosures 
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Theoretically,  the  overall  PIPR  rating  is  intended  to  provide  a  summary  rating 
based  upon  exceeding,  meeting,  or  failing  critical  and/or  required  job 
elements.   However,  ratings  on  individual  job  elements  and,  subsequently,  the 
summary  rating  may  be  affected  by  a  number  of  criteria  not  strictly  related  to 
observed  work  performance.   Please  answer  the  following  questions  based  upon 
your  personal  use  of  the  summary  rating. 

Al.   Has  a  summary  rating  been  affected  by  a  quota  established  by  a  higher 
office?  Yes     No 

A2.   Has  a  summary  rating  been  affected  by  an  employee's  desire  to  be 

promoted/transferred  where  a  high  PIPR  rating  would  be  required  to  be 
considered  for  a  promotion/transfer?  Yes     No 

A3.   Has  a  summary  rating  been  affected  by  your  desire  to  get  better  work,  out 
of  an  employee  in  the  future  rather  than  on  past  performance? 
Yes     No 

A4.   Has  a  summary  rating  been  affected  by  any  of  the  following: 

a.  potential  for  an  award?  Yes     No 

b.  merit  promotion  plan?  Yes     No 

c.  possible  reduction  in  force?       Yes     No 

A5.    If  you  answered  yes  to  any  of  the  above  questions,  to  what  extent  do 

factors  other  than  observed  work  performance  affect  the  summary  ratings? 

123456789     10 
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Through  discussions  with  individuals  who  have  worked  in  various  places 
throughout  the  Bureau,  it  is  evident  that  PIPRs  are  developed  in  a  variety  of 
ways.   Please  answer  the  following  questions  as  they  relate  to  your  present 
method  of  developing  PIPRs. 

Bl.   Do  your  employees  solely  prepare  their  own  PIPRs? 
Yes     No 

B2.   Do  you  solely  prepare  PIPRs  for  your  employees? 
Yes     No 

B3.   Do  you  and  your  employees  prepare  their  PIPRs  jointly? 
Yes   No 

B4.   Are  PIPRs  developed  each  year  based  upon  the  following: 

a.  position  description?       Yes     No 

b.  AWP  commitments?  Yes     No 

c.  previous  year's  PIPR?       Yes     No 


B5.   When  do  you  prep re  PIPRs? 

a.  start  of  fiscal  year 

b.  mid-year 

c.  end  of  fiscal  year 


B6.   Are  standarized  job  elements  and  objectives  used  for  some  tasks  (safety, 
EEO,  etc.)? 

Yes  No 


B7.    In  rating  performance,  do  you  solely  use: 

a.  qualitative  standards?  

b.  quantitative  standards?         

c.  or  a  comb  .at  ion? 


Yes 

No 

Yes 

No 

Yes 

No 

if  yes,  %      ualitative  ,  %  quantitative 

B8.   Are  PIPRs  reviewed  with  employees: 

a.  quarterly  

b.  semi-annually      

c.  annually  
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The  following  questions  are  for  you  to  evaluate  and  suggest  improvements  to 
the  PIPR  system. 

CI.    Do  you  think  the  PIPR  system  is  functioning  as  it  was  designed? 

Yes     No 

Why? 


C2.   Do  you  as  a  supervisor  use  the  PIPR  system  to  identify  employee 

development  needs?     Yes     No 

How? 


C3.   Do  you  feel  that  the  five  level  rating  system  is  adequate  and  fair? 

Yes     No 

Why?  


C4.   Do  you  think  such  things  as  awards,  salary  increases  through  the  merit 
promotion  plan,  etc.  should  be  tied  to  the  summary  PIPR  rating? 
Yes         No 


WhyS 


C5.   Do  you  feel  performance  is  affected  by  a  PIPR  rating? 
Yes  No 


Why  \ 


C6.   Generally,  do  you  think  your  employees  like  the  PIPR  system? 
Yes  No 


Why? 


C7.   Generally,  do  you  like  the  PIPR  system? 
Yes     No 

Why?  


APPENDIX  B 

Numerical  Summary  of  Responses  by  States 
and  Supervisory  Categories 


23 


Table  B-l 
Responses  to  Questions  A-l  through  A-5  by  State 


A-l 

1 
A-2  1 

A-3 

A-4 

a 

b 

c 

A-5 

State 

Yes  I  No 

Yes | No  lYesINo 

Yes 

No 

Yes  I  No 

Yes | No  |  j 

i    I  NR 

Alaska 

11  11 

1    1 
01  12| 

1  1  11 

1 

11 

11  11 

0|  121 

1   3 

Ari  zona 

0|  12 

01  121 

4|   8 

1 

11 

01  12 

0|  121 

1  o 

California 

51   5 

01  10| 

4|   6 

2 

8 

0|  10 

0|  10| 

1  o 

Colorado 

01  12 

21  101 

31   9 

0 

12 

01  12 

01  121 

1  o 

Eastern  States 

0|   2 

0|  2! 

1  1   1 

0 

2 

0|   2 

01   2| 

1  o 

Idaho 

51   7 

01  12| 

21   9 

4 

8 

0|  12 

21  101 

1  o 

Montana 

61   7 

11  121 

4|   9 

6 

7 

21  11 

21  11  1 

I   1 

Nevada 

41   7 

01  10| 

1  I  10 

0 

11 

0|  11 

01  11  ! 

I   1 

New  Mexico 

3|  10 

0|  13! 

5|   8 

2 

11 

0|  13 

01  131 

1   3 

Oregon 

21  17 

0|  191 

4|  15 

3 

16 

01  19 

31  161 

1  o 

Utah 

21  10 

11  HI 

3!   9 

2 

10 

0|  12 

11  11  I 

1   2 

Wyoming 

5!  8 

1  1  12| 
|   | 

5|   8 

6 

7 

51   8 

31  10| 

2 

Total  s 

331108 

5|135| 

371103 

27 

114 

81133 

11  11301 

12 
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APPENDIX  C 

BLM  Performance  Rating  Distribution  for  FY  84 

and  PIPR  Rating  Distribution  for  Colorado 

from  FY  82  tnrougn  FY  85 
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BLM  FY-84  Performance  Rating  Distribution 
(Levels  I  -  V) 

I  II  III  IV 


• 

Utah 

4.0% 

71 . 0% 

25.0% 

DSC 

7.H 

41.9% 

50.7% 

.1% 

Col orado 

13.0% 

63.0% 

23.0% 

.1% 

Idaho 

8.3% 

66.4% 

24.3% 

.4% 

.4% 

• 

Oregon 

8.4% 

63.7% 

27.4% 

.2% 

New  Mexico 

5.0% 

55.0% 

39.0% 

(2  level    IVs 

and  2  Vs) 

Eastern  States 

13.3% 

62.9% 

23.6% 

Wyoming 

5.8% 

54.2% 

39.8% 

.2% 

Nevada 

Arizona 

9.1% 

60.2% 

30.5% 

• 

Montana 

2.1% 

47.5% 

49.7% 

.3% 

.1% 

• 

California 

6.0% 

61.0% 

31.0% 

1.5% 

.5% 

Alaska 

15.0% 

54.6% 

29.7% 

.2% 

^Asterisked  states  reflect  PIPR  statistics  for  permanent  employees  only, 
Statistics  for  states  not  asterisked  include  temporary  employees. 
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COLORADO  STATE  OFFICE 
STATEWIDE  GS/WG  PIPR  RATINGS  FOR  FY-82,  83,  84,  and  85 


FY  82 
FY  83 
FY  84 
FY  85 


Level 
I 

Level 
II 

54% 

Level 
III 

37% 

Level 
IV 

1.5% 

Level 
V 

7% 

.5% 

10% 

63% 

27% 

- 

- 

13% 

63% 

23% 

2% 

- 

10% 

57% 

33% 

.2% 

.2% 

GM  PIPR  RATINGS  FOR  FY-85 

Bureauwide  19%  62%  19%  .5%  .1 

Colorado  21%  67%  12% 
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APPENDIX  D 

Review  of  Written  Responses  to 
Questions  C-l  through  C-7 
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The  following  are  based  upon  written  responses  to  questions  C-l  throuqh  C-7. 
The  written  responses  have  not  been  statistically  analyzed.  Basically,  the 
responses  were  recorded  according  to  whether  the  response  was  yes  or  no.  The 
written  responses  were  not  analyzed  by  state  or  supervisory  category.  It  is 
suggested  that  a  thorough  statistical  analysis  of  the  written  responses  be 
conducted.  Occasionally,  the  response,  in  my  opinion,  did  not  relate  to  the 
question,  the  respondent  checked  both  yes  and  no,  or  the  respondent  checked  yes 
and  wrote  a  negative  response.  These  types  of  responses  were  generally  not 
included  in  this  analysis.  Also,  many  supervisors  provided  more  than  one 
response  to  the  questions.  However,  the  following  should  provide  a  "flavor"  of 
what  was  the  major  written  responses  to  questions  C-l  through  C-7. 

C-l.  Do  you  think  the  PIPR  system  is  functioning  as  it  was  designed? 

Yes   No 

Why?" 

Twenty-eight  percent  of  the  respondents  (39)  ansv/ered  yes  to  this  question 
and  72  percent  (99)  answered  no. 

A.  Yes 

The  most  numerous  responses  related  to  measuring  performance:  "It 
provides  a  system  for  measuring  performance."  (8  responses);  "If  used 
correctly,  useful  to  measure  performance."  (2  responses);  "Employees 
know  what  is  expected  of  them."  (2  responses) 

Other  reponses  included:  "Quotas  are   killing  the  system."  {?. 
responses)  and  "Only  when  the  supervisor  is  willing  to  expend  the 
time  to  make  it  work."  (2  responses). 

B.  No 

There  was  a  great  deal  of  variation  in  the  no  responses  to  this 
questions. 

The  most  common  response  was  "It's  too  time  consuming."  (11). 
Other  responses  are  as  follows:  "Still  too  much  subjectivity  and 
inconsistency."  (10  responses);  "Difficult  to  establish  workable 
standards."  (8  responses);  "Supervisors  do  not  use  the  system 
properly."  (7  responses);  "Quotas."  (7  responses);  "Not  all  managers 
use  the  system  the  same."  (3  responses);  "Different  ratings  for  the 
same  work."  (3  responses);  "Ratings  creep  so  that  level  II  is 
average."  (4  responses);  "Too  many  things  tied  to  it  (awards,  EEO, 
RIF,  etc.)."  (5  responses);  "Too  many  parameters  established  at  state 
level."  (4  responses);  and  "Too  many  levels  involved."  (3  responses). 

A  few  interesting  comments  are:  "Trying  to  be  too  precise  with  an 
imprecise  concept.";  "We  are  placing  more  emphasis  on  the  PIPR  system 
than  we  do  on  our  programs  or  Bureau  mission.";  and  "It  was 
originally  designed  as  a  communication  tool  as  well  as  a  performance 
rating.   It  has  become  a  catch  all  for  higher  levels  of  management 
and  much  too  important  as  a  document  which  can  affect  career,  RIF, 
etc." 
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C-2.  Do  you  as  a  supervisory  use  the  PIPR  system  to  identify  employee  development 

needs?   Yes    No 

How?  

Seventy-nine  percent  (110  respondents)  answered  yes  to  tnis  question  wnile 
19  percent  (27  respondents)  answered  no. 

A.   Yes 

Fifty-tnree  supervisors  said  they  used  the  PIPR  to  identify  training 
needs,  while  nine  said  they  used  it  to  identify  special   assignments, 
and  six  said  they  used  it  to  identify  on-the-job  training.      Eight 
respondents  said  it  was  used  to  help  develop  an  IDP  (Individual 
Development  Plan),  and  seven  respondents  said  tney  used  it  to  identify 
why  deficiencies  are  occurring.     Of  all   the  written  responses,   the 
responses  to  this  question  were  by  far  the  most  consistent. 

C-3.     Do  you  feel   that  the  five-level    rating  system  is  adequate  and  fair? 

Yes  No 

Why?    

Fifty  percent  of  the  respondents  (69)  answered  yes  to  this  question  and  46 
percent  (64  respondents)  answered  no. 

A.  Yes 

The  overwhelming  response   (28)  was  that  the  five-level    rating  provides 
enough  options,  or  fair  enougn,   to  cover  all   aspects.     A  few 
interesting  comments  were:     "Although  it  is  too  difficult  to  get  rid  of 
a  level    IV  employees,   it  does  allow  for  that  option.";   "Allows  for  a 
spread.     The  application  gets  corrupted  to  levels   I   -   III,   so  the 
system  tends  to  be  a  three-tiered  system.";  and  "Allows  enougn  levels 
to  fill  most  situations.     Problem  is  more  in  area  of  supervisors  with 
different  expectations  of  what  levels  represent." 

B.  No 

Twenty-one  respondents  said  tney  would  prefer  a  three-level    system 
or  that  a  three-level    system  would  work  better  sometimes.     The  three 
levels  could  be   I   =  Outstanding,   II   =  Met,   and  III   =  Failed  to 
Meet.     Five  respondents  suggested  a  two-level    system  —  satisfactory 
and  unsatisfactory.      Other  responses   included:      "Too  subjective  and 
inconsistent."   (6  responses);   "Only  three-level    system  is  used  now." 
(5  responses);   and  "Employees  think  a  level    III   is  below  average." 
(5  responses). 

C-4.     Do  you  think  such  things  as  awards,  salary  increases  through  the  merit 
promotion  plan,  etc.,  should  b  tied  to  the  summary  PIPR  rating? 

Yes  No 

Why?  

Sixty-three  percent  (88  respondents)  answered  yes,  and  32  percent  (44 
respondents  answered  no  to  this  question. 
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A.   Yes 


There  was  no  single  dominant  response  to  this  question,  although  most 
supervisors  who  answered  yes  indicated  that  awards  should  he  hased 
upon  performance.  Some  of  the  responses  were:  "Any  awards  or  merit 
increases  predicated  on  performance  should  emanate  from  a  valid 
PIPR."  (8  responses);  "Awards  and  perks  should  be  tied  to  joh 
performance  and  the  PIPR  is  support  to  measure  and  document 
performance."  (6  responses);  "Awards  should  be  based  upon 
performance."  (6  responses);  "Best  way  to  get  a  feel  for  performance.' 
(5  responses);  and  "PIPRs  should  reflect  employee  performance 
improvement."  (4  responses).  Some  interesting  responses  included  on 
the  yes  side  were:  "Employees  will  have  some  responsibility  for 
performance  and  take  the  system  seriously.";  "I  thought  they  were."; 
"It  is  a  convenient  record  that  is  standardized.";  "How  else  would  do 
it?";  "Awards  of  whatever  type  are  key.  However,  the  awards  system 
is  more  screwed  up  tnan  the  PIPR  system.";  and  "The  PIPR  is 
comprehensive;  what  more  do  we  need?" 

B.   No 

As  with  the  yes  answers,  there  was  no  single  response  that 
dominated.  However,  "Too  much  variation/inconsistency  in  management 
evaluation."  and  "Too  much  subjectivity/variation  between 
supervisors."  accounted  for  almost  one-quarter  of  the  no  responses. 
Another  somewhat  common  response  was  "PIPR  rating  is  for  the  entire 
year.  Individual  and  isolated  occurrences  of  superior  performance 
may  have  occurred  and  should  be  recognized."  A  few  interesting 
comments  are:   "Tendency  to  inflate  ratings  when  tied  to  financial 
gain.";  "Too  much  1 aq  time  between  performance  and  award.";  and 
"Should  serve  its  original  purpose  -  determine  areas  needing 
improvement  and  performance  of  position.  Too  many  additions  tend  to 
eliminate  clarity  of  system." 

C-5.  Do  you  feel  performance  is  affected  by  a  PIPR  rating?  Yes 

No 
WhyT~_ 

Seventy-eight  percent  (107  respondents)  answered  yes  to  this  question 
while  18  percent  {25   respondents)  answered  no. 

A.   Yes 

Managers  were  not  at  all  consistent  in  providing  reasons  why  the  PIPR 
system  affected  performance.  A  good  many,  but  less  than  a  majority, 
indicated  that  performance  is  affected  in  a  negative  manner.  Some  of 
the  more  typical  responses  were:  "Employees  work  to  ensure  a  good 
rating."  (8  responses);  "Employees  try  to  raise  their  ratings  so 
they  can  feel  personal  improvement."  (3  responses);  "If  written 
correctly,  everyone  knows  what  to  expect."  (5  responses^;  and 
"Enhances  performance  through  good  communications."  (4  responses). 
Some  interesting  responses  were:  "Good  performers  want  to  do 
better.  Bad  performers  have  incentive  to  improve."  "Set  up  a 
'self-fulfilling  prophecy'  syndrome.   If  we  rate  an  individual  as  a 
III,  that's  the  performance  we  get.";  and  "Good  ratings  tend  to 
motivate  and  poor  ratings  foster  poor  morale." 
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B.   No 

The  most  common  response  to  those  answering  no  was  "Most  people 
perform  on  the  job  in  the  same  manner  and  to  the  same  degree  as  they 
would  without  a  PIPR  system."  (5  responses).  Other  interesting 
responses  were:  "Too  much  inconsistency  within  the  organization."; 
"Not  by  the  rating  but  by  the  PIPR  itself.  You  have  commitments  and 
goals  to  obtain  -  the  rating  is  sort  of  anticl imatic. " ;  and  "Ego, 
personal  pride,  drive,  career  goals,  etc.,  are  the  important  aspects 
contributing  to  performance." 

C-6.  Generally,  do  you  think  your  employees  like  the  PIPR  system?  Yes 

No 

Why?  

Twenty-nine  percent  (41  respondents)  answered  yes  to  this  question  and  63 
percent  (88  respondents)  answered  no. 

A.  Yes 

The  most  common  responses  to  this  question  were:  "Lets  them  know 
what's  expected  of  them."  (9  responses);  "Gives  a  measure  of  how  they 
are  doing."  (3  responses);  and  "Because  they  have  equal  input  with 
the  supervisor." 

B.  No 

A  few  responses  accounted  for  a  majority  of  the  no  answers  to  this 
question.  These  included:  "Too  time  consuming."  (16  responses); 
"Too  complicated/cumbersome."  (8  responses);  "Too  much  subjectivity." 
(8  responses);  "Lack  of  consistency  among  rating  officials."  (7 
responses);  "Employees  see  inequities  in  ratings,  awards,  and 
promotions."  (4  responses);  and  "Variation  in  perceived  performance." 
(3  responses). 

C-7.  Generally,  do  you  like  the  PIPR  system?  Yes   No 

Why? 

Fifty-one  percent  (71  respondents)  answered  yes  to  this  question,  while  43 
percent  (60  respondents)  answered  no. 

A.   Yes 

There  was  a  great  variety  of  answers  in  the  yes  responses.  "Forces 
communication."  was  the  most  common  response  (9  responses).  Other 
somewhat  common  responses  were:  "Nothing  better  available."  (5 
responses);  "Identifies  workloads."  (4  responses);  "Provides  measure 
of  performance."  (3  responses);  "With  all  its  faults,  it's  at  least 
an  acceptable  way  to  measure  performance."  (4  responses);  and  "Both 
supervisor  and  employee  can  focus  on  workload  items  and  can  identify 
needed  assistance  or  help."  (4  responses).  In  addition  to  the  above, 
there  were  a  number  of  interesting  responses:  "Problem  is  that  it 
doesn't  deal  well  with  the  very  numerous  unexpected  tasks  we  end  up 
dealing  with.";  "As  long  as  we  keep  it  simple.   If  we  try  to  add  too 
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mucn,   including  standardized  elements,   it  will    defeat  its  purpose."; 
and  "I  like  the  idea  of  developing  a  plan  of  what's  to  be  done,  but  I 
think  PIPRs  are  too  long  and  involved.     Developing  standards  and 
objectives  for  program  leads,  managers  that  are  quantitative  can  be 
very  difficult  and  is  an  area  needing  improvement.     The  time  it  takes 
to  develop  and  type  them  is  too  much.     The  format  is  horrible  and 
needs  to  be  revised.     Other  than  that,  they're  find.     Good  luck] 
Changes  are  needed.";  and  "If  you  have  an  employees  with  performance 
problems,   PIPRs  are  the  major  tool  you  have  to  identify  the  problem 
and  work  toward  a  solution.     Something  to  measure  performance  is 
necessary." 


B.       No 

"Too  much  time."  was  the  overwhelming  reason  given  by  those  who  did 
not  like  the  PIPR  system  (26  responses).  Other  prominant  responses 
included:  "Too  complicated/too  much  paperwork."  (9  responses); 
"Three  levels  would  be  better."  (5  responses);  "Mot  fair/consistent." 
(4  responses);  "Doesn't  affect  performance  that  much."  (4  responses); 
"Quotas."  (4  responses);  and  "No  uniformity  in  standards  or  ratings." 
(4  responses). 

Summary 

The  variety  of  written  responses  to  questions  C-l  through  C-7  is  very 
interesting.  However,  there  were  a  number  of  themes  that  surfaced  throughout 
the  responses.  These  tnemes  appear  to  be  of  major  concern  to  most  supervisors. 
Many  supervisors  think  the  PIPR  process  is  too  time  consuming  and  complicated 
but  that  some  type  of  system  is  needed  to  measure  performance.  There  still 
appears  to  be  too  much  inconsistency  and  subjectivity  in  the  application  of  the 
summary  PIPR  rating,  but  employees  like  to  know  what  is  expected  of  them.  The 
PIPR  system  tends  to  have  an  adverse  affect  on  morale,  and  quotas  are  becoming 
far  too  pervasive.  Many  supervisors  feel  it  is  difficult  to  write  good 
standards.  And,  finallyr  some  supervisors  feel  the  PIPR  should  basically  be  a 
contract  between  the  employee  and  the  supervisor. 
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